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(57) Abstract: 

PROBLEM TO BE SOLVED: To 
efficiently execute the change and 
rearrangement of video 
communication by performing the 
change and rearrangement 
processings of a video position on a 
bit stream in the case of position- 
changing or rearranging video images 
during a conference by a video 
conference system. 

SOLUTION: A variable length 
position processing part 31 of an 
image position processing part 10 
performs only variable length 
decoding so as not to generate the 
loss of the information of an inputted 
MPEG2 bit stream and extracts 
motion vector information included 
in the MPEG2 bit stream. A motion . 
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information processing part 32 adds 
motion information for changing the 
video position to the motion vector 
information and a data reconstruction 
part 33 rewrites the data of the 
MPEG2 bit stream based on the 
motion vector information to which 
the motion vector information is 
added and reconstructs the MPEG2 
bit stream of one screen. A variable 
length encoding part 34 variable 
length encodes the reconstructed 
MPEG2 bit stream of one screen, 
returns it to the MPEG2 bit stream 
data of an original transmission form 
and outputs them to a transmission 
line 1. 
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(57) [Abstract] 

[Technical problem] While holding TV meeting between many points, two or 
more modification and reshuffles of the display position of a small 
screen which divided a certain screen are performed efficiently. 
[Means for Solution] The image location processing section 10 of MCU6 of 
this multi-point TV conference-communications system, MPEG 2 by which 
variable length coding was carried out It considers as the bit stream 
which carried out the variable-length decode of the bit stream data, and 
had encoded information, such as DDA information, and motion vector 
information, DCtau multiplier component information, to those, such as a 
start code. The variable-length decoder 31 which extracts the motion 
vector information on a migration place image' s contained in encoded 
information migration before, The motion information processing section 
32 which searches for the difference of the motion vector information on 
a migration place extracted image' s migration before. The data 



reconstruction section 33 which reconstructs the bit stream of one 
screen after adding the difference information on the motion vector 
information searched for to a bit stream, It is the bit stream 
reconstructed by the data reconstruction section 33 MPEG 2 The variable- 
length encoder 34 decoded and outputted to bit stream data is provided. 
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CLAIMS 



[Claim(s)] 

[Claim 1] Communication system with which two or more pictorial 
communication terminals which are characterized by providing the 
following, and which have been arranged at a different point are 
connected through a multi-point control unit and a two-way communication 
way, and said multi-point control unit relays the communication link 
between said each pictorial communication terminal A variable-length 
decode means to extract the motion vector information on a migration 
place image' s which considers as bit stream in which said multi-point 
control device' s had encoded information' s which carries out the 



variable- length decode of bit stream data of predetermined coding method 
by which variable length coding' s was carried out, and includes motion 
vector information' s at least, and is contained in encoded information 
of this bit stream migration before A motion information difference 
calculation means to search for the difference of the motion vector 
information on a migration place image* s extracted by said variable- 
length decode means migration before A data reconstruction means to 
reconstruct the bit stream of one screen after adding the difference of 
the motion vector information searched for by said motion information 
difference calculation means to the bit stream by which variable-length 
decode was carried out with said variable-length decode means A 
variable-length-coding means to decode and output the bit stream 
reconstructed by said data reconstruction means 

[Claim 2] The multi-point control unit characterized by providing the 
following. A variable-length decode means to extract the motion vector 
information on a migration place image' s which considers as bit stream 
with encoded information which carries out the variable-length decode of 
bit stream data of predetermined coding method by which variable length 
coding' s was carried out, and includes motion vector information' s at 
least, and is contained in encoded information of this bit stream 
migration before A motion information difference calculation means to 
search for the difference of the motion vector information on a 
migration place image' s extracted by said variable-length decode means 
migration before A data reconstruction means to reconstruct the bit 
stream of one screen after adding the difference of the motion vector 
information searched for by said motion information difference 
calculation means to the bit stream by which variable-length decode was 
carried out with said variable-length decode means A variable-length- 
coding means to decode and output the bit stream reconstructed by said 
data reconstruction means 

[Claim 3] In the graphic display approach which displays the encoded 
information which carried out compression coding of the image by the 
predetermined animation coding method on the request location in the 
larger display screen than the screen of the image which encoded When 
displaying the image which performed said coding on a different location 
from the time of coding, the motion vector information on a migration 
place is extracted from said encoded information migration before. The 
graphic display approach characterized by computing the difference of a 
mutual motion vector, decoding the encoded information which 
reconstructed and reconstructed the encoded information of one screen 



♦ • 

based on the difference information, and displaying an image on the 
migration location in said display screen. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the multi-point 
control unit and the graphic display approach which are used for 
communication system and this communication system. 
[0002] 

[Description of the Prior Art] In the case of the communication system 
which a multi-point control unit relays the dynamic-image communication 
link between each terminal, and performs it, two or more pictorial 
communication terminals installed in a different point from the former 
are connected by the two-way communication circuit, and since there is 
much amount of information, there is a delay problem of the conversion 
time in a multi-point control unit (MCU), and an improvement is desired. 
[0003] In recent years, the spread of the communication system between 
the remote places which can hold a conference in the distant location 
(tauV conference system) is progressing with the advance of 
communication technology. As for such a tauV conference system, the 
thing which comes to connect the pictorial communication terminal of a 
point-to-point by the two-way communication circuit is one of things of 
a simple configuration. In this case, it is common to transmit the 
dynamic-image communication link of both directions with the same coding 
method and the same transmission speed. As a method which encodes a 
dynamic image, there are H. 261 (ITU-T Rec.H.261), MPEG 2 (ISO/IEC 138 
18|ITU-T Rec. H. 261), etc. as international standards. 
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[0004] By the way, as shown in drawing 5 , the multi-point tauV 
conference system which connected to the two-way communication circuit 
51 two or more image communication terminals 52a-52c with which three or 
more points are dotted, and the multi-point control unit (MCU) 53 is 
constituted, and a communication link may be performed now. Two or more 
decoders 61a-61c which carry out decode processing of the bit stream 
sent through the two-way communication circuit 51 from each terminals 
52a-52c etc. at the information for every screen as the above MCU53 is 
shown in drawing 6 , It consists of the editing-on-screen section 62 
which edits the information for every decoded screen, and encoders 63a- 
63c which encode the information for every edited screen and are sent to 
the terminals 52a-52c of an every place point. 

[0005] In the case of this multi-point tauV conference system, the image 
information (image information) transmitted from two or more terminals 
52a-52c is H. 261. A bit stream will encode by a method etc., and it will 
be transmitted to the two-way communication circuit 51 on it, and will 
communicate by MCU53 installed in a certain point acting as intermediary. 
[0006] In MCU53, once decode processing of the bit stream sent through 
the two-way communication circuit 51 from each terminals 52a-52c is 
carried out by each decoders 61a-61c, edit of a screen is performed in 
the editing-on-screen section 62, and it encodes with each encoders 63a- 
63c with which the screen after edit corresponds, and is sent to the 
terminals 52a-52c of an every place point. 

[0007] By the way, in this tauV conference system between many points, 
the place of the location of the image currently displayed on each 
smallness screen which divided the screen of each terminal into some 
small screens while performing a television conference, and displayed 
and divided the image of the terminal of several remaining two or more 
point minutes or what the selected point may be changed. 
[0008] Like the above also in this case, after carrying out decode 
processing of the sent bit stream by each decoders 61a-61c at MCU53, it 
edits on screen in the editing-on-screen section 62 for every screen, 
and with each encoders 63a-63c, again, it encodes to a bit stream and 
the information for every screen after edit processing is transmitted to 
it. 

[0009] In this case, in order to edit image information for every screen 
in the editing-on-screen section 62, when there is very much amount of 
information, such a configuration is unsuitable in the communication 
link as which each processing of decode, editing on screen, coding, etc. 
' takes much time amount, and real time nature is required like a 
television conference like a dynamic image. 



[0010] On the other hand, it is MPEG 2. By the method, the transmitted 
bit stream can be processed as it is, without performing useless 
processing in which it encodes again after decode, and connection with 
many points can be made. 

[0011] Namely, MPEG 2 MCU70 using a method becomes configurations, such 
as the variable-length decode section (VLD) 71, the data reconstruction 
section 72, and the variable-length-coding section (VLC) 73, as shown in 
drawing 7 . 

[0012] In this case, MPEG 2 transmitted from each terminal in MCU70 
Variable-length decode (VLD) is performed for a bit stream in the 
variable-length decode section (VLD) 71. It changes into those, such as 
a start code, at a bit stream with encoded information, such as DDA 
information, and motion vector information, DCtau multiplier component 
information. The bit stream is reconstructed to one screen in the data 
reconstruction section 72, variable length coding of the bit stream 
after reconstruction is again carried out in the variable-length-coding 
section (VLC) 73, and it is MPEG 2 to the terminal of an after that and 
every place point. It sends by the bit stream. 

[0013] In this case, MPEG 2 In a method, in order to perform coding 
processing and decode processing with reference to a front image (screen 
information), also when performing a reshuffle of a small screen etc., 
an image location will be changed to the image timing of an inter-frame 
sign. 

[0014] However, when modification of an image location arises from 
decoding MCU70 with reference to a front image too much greatly, the 
target image is no longer acquired. Reshuffle processing of a screen etc. 
will perform location conversion of an image to the timing of the image 
of the sign in a frame, and it becomes impossible therefore, to perform 
it by desired time amount now. 
[0015] 

[Problem (s) to be Solved by the Invention] Thus, the conventional MPEG 2 
mentioned above While holding tauV meeting, the screen was divided into 
two or more small screens, and when repositioning the image displayed on 
each smallness screen, an image location will be changed to the image 
timing of an inter-frame sign, and there was a trouble that the 
conversion efficiency in the case of changing the place of an image was 
bad, by MCU using a method, i. e. , a multi-point control unit. 
[0016] It was made in order that this invention might solve such a 
technical problem, and it aims at offering the communication system 
which can perform modification and a reshuffle of an image location 
efficiently, a multi-point control unit, and the image information- 



display approach. 
[0017] 

[Means for Solving the Problem] In order to attain the above-mentioned 
purpose, the communication system of invention according to claim 1 In 
the communication system with which two or more pictorial communication 
terminals arranged at a different point are connected through a multi- 
point control unit and a two-way communication way, and said multi-point 
control unit relays the communication link between said each pictorial 
communication terminal It considers as the bit stream in which said 
multi-point control device had the encoded information which carries out 
the variable-length decode of the bit stream data of the predetermined 
coding method by which variable length coding was carried out, and 
includes motion vector information at least. A variable-length decode 
means to extract the motion vector information on a migration place 
image's contained in encoded information of this bit stream migration 
before, A motion information difference calculation means to search for 
the difference of the motion vector information on a migration place 
image' s extracted by said variable-length decode means migration before, 
A data reconstruction means to reconstruct the bit stream of one screen 
after adding the difference of the motion vector information searched 
for by said motion information difference calculation means to the bit 
stream by which variable-length decode was carried out with said 
variable-length decode means, A variable-length-coding means to decode 
and output the bit stream reconstructed by said data reconstruction 
means is provided. 

[0018] The multi-point control device of invention according to claim 2 
is made into a bit stream with the encoded information which carries out 
the variable-length decode of the bit stream data of the predetermined 
coding method by which variable length coding was carried out, and 
includes motion vector information at least. A variable-length decode 
means to extract the motion vector information on a migration place 
image's contained in encoded information of this bit stream migration 
before, A motion information difference calculation means to search for 
the difference of the motion vector information on a migration place 
image* s extracted by said variable-length decode means migration before, 
A data reconstruction means to reconstruct the bit stream of one screen 
after adding the difference of the motion vector information searched 
for by said motion information difference calculation means to the bit 
stream by which variable-length decode was carried out with said 
variable-length decode means, A variable-length-coding means to decode 
and output the bit stream reconstructed by said data reconstruction 





means is provided. 

[0019] In the graphic display approach which displays the encoded 
information to which the graphic display approach according to claim 3 
carried out compression coding of the image by the predetermined 
animation coding method on the request location in the larger display 
screen than the screen of the image which encoded When displaying the 
image which performed said coding on a different location from the time 
of coding, the motion vector information on a migration place is 
extracted from said encoded information migration before. It is 
characterized by computing the difference of a mutual motion vector, 
decoding the encoded information which reconstructed and reconstructed 
the encoded information of one screen based on the difference 
information, and displaying an image on the migration location in said 
display screen. 

[0020] In this invention, after decoding to the bit stream with the 
encoded information which includes motion vector information for the 
encoded bit stream data at least and adding the motion information by 
repositioning of an image to the motion vector information, the bit 
stream data of one screen are reconstructed and it encodes. That is, 
since modification of an image location and processing of a reshuffle 
are performed on a bit stream, the image displayed on the display screen 
can be repositioned efficiently. 
[0021] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of 
this invention is explained to a detail with reference to a drawing. 
[0022] Drawing 1 is the schematic diagram showing the configuration of 
the multi-point communication system which is one operation gestalt 
concerning this invention. 

[0023] In this drawing, 1 is information communication networks 
(transmission line), such as CATV. Two or more terminals 2-5 are 
connected to this transmission line 1 through MCU6. That is, this multi- 
point communication system is constituted as the video signal from each 
terminals 2-5 relayed in MCU6. 

[0024] The cameras 2a, 3a, 4a, and 5a which are arranged towards a 
meeting participant, photo a meeting participant to each terminals 2-5, 
and acquire the image, It is the video signal photoed with each cameras 
2a, 3a, 4a, and 5a MPEG 2 Encoder 2b, and 3b, 4b and 5b which carry out 
compression coding by the method at bit stream data, and transmit to 
MCU6 through a transmission line 1, A transmission line 1 is led from 
MCU6, and it is MPEG 2. Bit stream data are received and the decoders 2c, 
3c, 4c, and 5c decoded to a video signal and the monitors 2d, 3d, 4d, 




arid 5d which display the decoded video signal on the display screen are 
formed. The image location processing section 10 which carries out 
modification processing of the image location on a bit stream is formed 
in MCU6. The image location processing section 10 is received MPEG 2. 
The image positional information which should move to bit stream data is 
added, and it transmits to each terminal. MPEG 2 Since the size of the 
screen to transmit can be specified by the encoder side by the method, 
at this operation gestalt, it is MPEG 2 as an image coding method. The 
method is used. 

[0025] The image location processing section 10 is MPEG 2 inputted as 
shown in drawing 2 . Only variable-length decode (VLD) is performed so 
that informational loss may not generate a bit stream if possible. MPEG 
2 The variable-length decode section 31 which extracts the motion vector 
information included in a bit stream (MPEG 2 VLD), The motion 
information processing section 32 which adds the motion information for 
changing an image location into the motion vector information, It is 
MPEG 2 based on the motion vector information to which motion vector 
information was added. The data reconstruction section which performs 
data rewriting of a bit stream and reconstructs the MPEG 2 bit stream of 
one screen. Variable length coding (VLC) of the MPEG 2 bit stream of one 
reconstructed screen is carried out, and it is MPEG 2 of the original 
transmission gestalt. It returns to bit stream data and consists of the 
variable-length-coding sections (MPEG 2 VLC) 34 outputted to a 
transmission line 1. 

[0026] Multi-point communication system of this operation gestalt is 
performed without dropping data junction effectiveness in MCU6, when 
replacing the meeting participant' s A screen, and the meeting 
participant' s D screen as shown in drawing 4 while displaying the screen 
of the image of meeting participant A-D of two or more terminals in the 
display screen of terminals 2-5 as shown in drawing 3 . 
[0027] That is, at MCU6, migration processing, reconstruction, etc. of 
screen information are performed with the gestalt of a bit stream, 
without considering as the screen which decoded the sent bit stream data 
completely. 

[0028] Hereafter, concrete actuation of this multi-point communication 
system is explained. 

[0029] In the case of this multi-point communication system, a meeting 
participant' s image photoed with the cameras 2a, 3a, 4a, and 5a 
connected to each terminals 2-5 is MPEG 2 at encoder 2b within each 
terminal 2-5, and 3b, 4b and 5b. Bit stream data encode and it is 
transmitted to MCU6 through a transmission line 1. 



[0*030] At MCU6, it is a transmission line 1 to MPEG 2. When bit stream 
data are received, it is the MPEG 2. Bit stream data are passed to the 
image location processing section 10. 

[0031] At the image location processing section 10, MPEG 2 bit stream 
data are MPEG 2, such as header information and motion vector 
information, by the variable-length decode section (MPEG 2 VLD) 31. Only 
variable-length decode (VLD) is performed to extent which the 
information which a bit stream has understands. VLD(ed) MPEG 2 The 
motion vector information included in a bit stream is extracted, and the 
difference of the location number of the migration place of an image 
moves, and it asks as information. 

[0032] The difference of the location number called for as motion 
information is passed to the motion information processing section 32. 
Moreover, MPEG 2 which performed only VLD A bit stream is outputted to 
the data reconstruction section 33. 

[0033] In the motion information processing section 32, the passed image 
positional information which moved, and generated and generated image 
positional information based on information is added to motion vector 
information, and the motion vector information is outputted to the data 
reconstruction section 33. 

[0034] In this case, it moves, and in the motion information processing 
section 32, after [ which performed variable-length decode (VLD) ] 
asking, the difference information on informational is added to the 
extracted information. 

[0035] For example, slice-vertical-position which is the position 
information on a slice of the vertical component of the motion 
information An image location is changed as an inter-frame sign which 
refers to a front image in the data reconstruction section 33 by adding 
to macroblock-address which is the address information of a macro block 
of a perpendicular and horizontal both components, updating a location 
number, or moving to the motion vector information itself and adding 
information. 

[0036] in addition, a macro block and intra of the head of a slice ~ 
macro BUROKKUHE detected with the motion vector prediction vessel when 
the reset information on motion vector prediction machines, such as a 
macro block, was detected ~ motion vector information is added each 
time. 

[0037] MPEG 2 which performed only VLD in the data reconstruction 
section 33 The motion vector information from the motion information 
processing section 32 is inserted in a bit stream in the original 
location, and a bit stream is MPEG 2 of one screen. It is reconstructed 



by the bit stream. MPEG 2 of one reconstructed screen A bit stream is 
MPEG 2 of the original transmission gestalt at the variable-length- 
coding section (MPEG 2 VLC) 34. It is returned to bit stream data and 
transmitted to each terminals 2-5 through a transmission line 1. 
[0038] MPEG 2 sent to each terminals 2-5 from the transmission line 1 
Bit stream data are decoded to a video signal with the decoders 2c, 3c, 
4c, and 5c within each terminal 2-5, and are outputted to the monitors 
2d, 3d, 4d, and 5d connected to each terminals 2-5. 
[0039] In addition, the directions actuation of the change of two or 
more image screens, a reshuffle, etc. currently displayed on the 
monitors [ of each terminals 2-5 / 2d 3d, 4d, and 5d ] display screen 
Although it is possible carrying out a direct control from each 
terminals 2-5, and replacing the meeting participant' s A image and the 
meeting participant' s D image which were shown in drawing 6 , and to 
issue directions In addition, those who are talking may always be made 
to be displayed on a fixed location as the image screen of the meeting 
participant who is talking is displayed on the upper left in the fixed 
position on a display screen, for example, a display screen, etc. In 
this case, in MCU6, it will detect from the voice data contained [ which 
is the terminal of the meeting participant who is talking, and ] in the 
bit stream sent from each terminal, and the image location by bit stream 
conversion will be replaced. 

[0040] When moving all or either of the image screens by which it was 
indicated by two or more on the display screen of the monitor of each 
terminals 2-5 according to the multi-point communication system of this 
operation gestalt, thus, in MCU6 MPEG 2 It is a bit stream MPEG 2 
Variable-length decode (VLD) is carried out to extent which the 
information which a bit stream has understands. MPEG 2 which VLD(ed) The 
motion vector information included in a bit stream is extracted. The 
difference of the location number of a migration place is searched for 
migration before of an image, and it is MPEG 2 of one screen based on 
the difference. It reconstructs to a bit stream. Variable length coding 
of it is carried out, it outputs, that is, since location transform 
processing of modification of an image location or a reshuffle is 
performed with the gestalt of an MPEG 2 bit stream, modification and a 
reshuffle of an image location can be performed efficiently. 
[0041] That is, sent MPEG 2 Since an image location is not moved when 
decoding a bit stream even on an image screen by the decoder and 
reconstructing four screens on one screen, generating of the delay at 
the time of image reorganization ends few. 

[0042] Moreover, since the above-mentioned processing is performed in 



the state of bit stream data, degradation of image quality can be made 
fewer than the time of repositioning after reproducing the image in 
every sheet. In addition, this invention is not limited only to the 
operation gestalt mentioned above. 

[0043] the operation gestalt mentioned above — as an image coding 
method — MPEG 2 although the method was applied — except [ this ] — 
for example, H. 261 etc. ~ a coding method may be applied. 

[0044] 

[Effect of the Invention] Modification and a reshuffle of an image 
location can be performed efficiently, without dropping the real time 
nature of an image communication link according to this invention, since 
modification and reshuffle processing of an image location are performed 
on a bit stream when performing repositioning and a reshuffle of an 
image while holding a conference with tauV conference system as 
explained above. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] Drawing showing the multi-point tauV meeting structure of a 

system of one operation gestalt of this invention. 

[Drawing 2] The block diagram showing the configuration of MCU of the 

multi-point tauV conference system of drawing 1 . 

[Drawing 3] Drawing showing an example which divided the screen of a 

certain terminal into four small screens, and displayed the image. 

[Drawing 4] Drawing showing the case where the place of the image of the 

screen of drawing 3 is changed. 

[Drawing 5] Drawing showing the conventional multi-point tauV meeting 
structure of a system. 



} 




[Drawing 6] Drawing showing the configuration of the multi-point control 
unit (MCU) of the multi-point tauV conference system of drawing 5 . 
[Drawing 7] The conventional MPEG 2 Drawing showing the configuration of 
MCU using a method. 
[Description of Notations] 

1 ~ A transmission line, 2-5 ~ A terminal (MPEG 2 CODEC terminal), 6 - 

- Multi-point control unit (MCU), 10 ~ The motion information 
processing section, 2a, 3a, 4a, 5a ~ A camera, 2b, 3b, 4b, 5b ~ An - 
encoder (ENCODER), 2c, 3c, 4c, 5c ~ Decoder (DECODER), 2d, 3d, 4d, 5d - 

- A monitor, 31 ~ MPEG 2 An encoder (MPEG 2 VLD), 32 [ ~ MPEG 2 / 
Decoder (MPEG 2 VLC). ] ~ The image positional information storing 
section, 33 ~ The data reconstruction section, 34 
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